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Abstract: The almost exponential stability for a stochastic recurrent neural network with time-varying 
delays is discussed by means of a nonnegative semi-martingale convergence theorem, the 
Lyapunov functional method and the characteristics of stochastic delay recurrent neural 
networks. The new algebraic criteria of the almost exponential stability for the stochastic 
recurrent neural network with time-varying delays is derived. These algebraic criteria are 
simple and practical. Two examples show these new algebraic criteria are better than the 
relative criteria for the stochastic Hopfield neural network. 
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1 Introduction 


Recurrent neural networks have many kinds of applications. Wang and Wu!!! presented 
a multi-layer recurrent neural network for solving continuous-time algebraic matrix Riccati 
equations in real time. Zhang, Jiang and Wang! presented a recurrent neural network for 
solving the Sylvester equation with time-varying coefficient matrices. Zhang and Gel®! presented 
a general recurrent neural network (RNN) model for solving the online inversion of time-varying 
matrices. 

The stability of stochastic neural networks was initiated to study by Liao and Mao in 
[4,5]. Blythe, Mao and Liao!) studied the almost sure stability of stochastic Hopfield neural 
networks. Niu, Zhang and Xul”! studied exponential stability in mean square for stochastic 
Cohen-Grossberg neural network with varying delays. Zhang, Xu and Deng!®) studied exponen- 
tial stability for a stochastic reaction-diffussion neural network with time-varying delays. Jiang, 
Shen and Liao!) studied the almost sure stability for a kind of stochastic differential equations 
with time-varying delays. 


This paper discusses almost sure exponential stability of the following stochastic recurrent 
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neural networks with time delays 


dz(t) = ( ~ Da(t) + Af(a(t)) + Bg(xr(t)))dt + o (x(t), x,(t), t)dW (t), a 


saa Su. Seeds: 
where D = diag(d;,--- ,dn), A = (@ij)nxn, B = (biz)nxn, F = max{r;:1<i< n}, 
fle) = (Ala) staa), oe) = (ata) galal- a), 
o (z(t), 2(t),t) = (oij(2(t),tr(t)st)) pics Trt) = (216 = 7), Enlt- Ta) 5 


and £(s) (-T < s < 0) is a continuous R”-valued stochastic process such that every (s) 
is Fọ-measurable and Ejê(s)|? < 00. n denotes the number of neurons in a neural network, 
xi(t) corresponds to the state of the ith neuron at time t, f;(z;(t)), 9;(2;(t)) denote the 
activation functions of the jth neuron at time t, a;; denotes the constant connection weight 
of the jth neuron on the ith neuron at time t, b;; denotes the constant connection weight of 
the jth neuron on the ith neuron at time t — Tj, d;i > 0 represents the rate with which the 
ith neuron will rest its potential to the resting state in isolation when disconnected from the 
networks and external inputs. W(t) = (Wi(t),--- ,Wm(t))? is an m-dimensional Brownian 
motion which is defined on a complete probability space (Q, F,P) with a natural filtration 
{Fi}i>o (ie. Fy = o{W(s):0 < s < t}). 

. Assume f, g and ø are locally Lipschitz continuous and satisfy the linear growth condition 
as well. So it is known that (2) has a unique global solution on t > 0, which is denoted by 
z(t;€). Moreover, assume also that f(0) = 0, g(0) = 0 and o(0,0,t) = 0 for the stability 
purpose of this note. So (2) admits an equilibrium solution x(t; 0) = 0. 

This paper deals with the almost exponential stability of model (1). The new algebraic 
criteria of the almost exponential stability for the stochastic recurrent neural network with 
time-varying delays is derived. These criteria are simple and practical. Furthermore, if A = 0 
in (1), the model (1) changes into the stochastic Hopfield neural network which was studied 
in [6]. Two examples in section 3 show that these new algebraic criteria are better than the 
relative criteria given in [6] for the stochastic Hopfield neural network. 


2 Main results 


Let C>1(R” x R}; R+) denote the family of all nonnegative functions V (x,t) on R” x Ry 
which are twice continuously differentiable in x and once differentiable in t. For each V € 
C?(R" x R}; R+), define an operator CV, associated with the stochastic delay neural network 
(1), from R” x R” x R, to R by 


LV(z,y,t) = Vi(x,t) + V.(2,t)[ - Dz + Af (x) + Bgly)] + 5 [o7 (a, y, t)Vez0(zx, y, t)], 


where 


8V (a, 


Oz, ; i Tn 


Vilx, t) = —, V, (2, t) on (Mas : Wey is 
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Let C(R”; R+) denote the family of all continuous functions from R” to R4, while C((—7, 0]; 
R”) denote the R”-valued continuous functions from [-7,0] to R”. 

To obtain our results, we need the following assumptions. 

(H1): There exist positive constants a; such that |f(a;)| < a,|z;|, i= 1,2,-+-,n. 

(H2): There exist positive constants 8; such that |g(z;)| < Bilzih i= 1,2,--- ,n. 

Theorem 2.1 Assume that there exist a number of functions V € C?1(R"x R4; R+), $j € 
C(R; R+), Yi € C(R; Ry) (1 < i < n) and 3n constants A; > pi > 0, pi > O(1 <i <n) such 
that 


LV(z,y,t) < a (—AiPi(ai) + webi(ys)), (a, y,t) E.R” x R” x Ry, (2) 

V(z, t) < X pidi(ai), (z, t) eR" x Ry, (3) 
i=l 

Wilzi) < di(ai), zER. (4) 


Then, for every € € C([—-7,0]; R”), the solution of (1) has the property 


3 1 
jim, sup t log (V (z(t; £), t)) < TY, 4.8., 
where y is the root of the equation 


_ Ag — pie”? 
y= min ~——*_. 
I<i<n p 


Proof Fix initial data € € C((—7, 0]; R”) arbitrarily and write simply z(t; £) = z(t). Define 
U(az,t) = eV (x,t) for (x,t) € R” x R4, which is in C?1(R" x R4; R+) obviously. We can 
compute 


LU(z,y,t) = Ye”%V (x,t) +e°Vi (2, t) + e”Vs(z,t)[- De + Af (a) + Boly)] 


1 
+5" [07 (z, y,t)Vzso(2,y,t)] 


li 


e% [yV (z, t)+ LV(a,y,t)}. 


Using conditions (2) and (3), we have 
n nm 
LU(z,y,t) < e” [ -J Ai- pingil) + SO pibs(ys)]. 
i=1 i=l 
The It6 formula shows that for any t > 0, 


eV (az,t) = V(2(0),0) + f £U(e(8),2-(8),s)as + f eV, (x(s), s)o(x(s),27(s), 8)dW(s) 


IA 


V (€(0),0) — Soi = on f e%°ġi(zi(s))ds + Yom f eb; (ai(s — Ti))ds 
iat i=l 


+ 1 eV, (x(s), s)o (x(s), £+ (8), s)dW(s). (5) 
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On the other hand, we have 
t t t 
f ey; (zi(s)}ds = J eyi(as(s))as— f e=) yp; (zils — Ti))ds 
t-Ti Th 0 


< f eyi (xi(s)}ds — [ ey; (ai(s — %)) ds. 


—F 


This implies 


f ey; (xi(s — Ti))ds < J : eyi (2i(s))ds — em f ey; (x;(s))ds. (6) 


It then follows from (5) and (6) that 


e”V(a,t) < V(E(0),0 ESSE -pme f eb; (x;(s))ds 


i=1 


+" i bi (Gla)as~e" Dn [ esp; (zi(s)) ds 


t—Ti 


+f eV, (x(s), s)o(x(s), 2-(s), 8) dW(s). 
o 


Furthermore, we have that 


eV (a(t),t J+ om A esy (z:(8))ds < X(t), (7) 


t-Tj 


where 


X(t) = V (€(0),0 +e om fe e% pi (&(s))ds 


+f eV, (x(s), s)o(x(s),27(s),s)dW(s), 


which is a nonnegative semi-martingale because of V (x,t), Wi(xi), Hi, Ti being nonnegative and 
inequality (7), and nonnegative semi-martingale convergence theorem!) shows 


lim X(t,w)< 00, a.s.. 
#00 
It therefore follows from (7) that 
lim sup [eV (z,t)] <œ, a.s., 
t-00 


which implies 
1 
lim sup = log (V (z(t; £),t)) < -7, a.s. 
t-00 t 


as required. The proof is complete. 
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Theorem 2.2 Under (H2), assume there exist symmetric nonnegative-definite matrices 
Cı, C2, C3 = diag(é1,--- , ôn) and C4 such that 


trace [o7 (2, Y, t)o(z, y, t)] < a? Cyr + g7 (y)C2g(y) + y7 Cay, (8) 
a? Af(x) + fT(z)ATz < 27 Caz, (9) 


for all (z,y,t) € R” x R” x R}. Assume also that there exists a positive-definite diagonal 
matrix G = diag(gi,--- , gn) such that the symmetric matrix 


—2D + C1 +03 +C4 + D B 
BT -G + C2 


is negative-definite, where D = diag(g,G?,--- ,gn82). Let —À = Amax(H), the biggest eigen- 
value of H. So À > 0. Then, for every € € C([—7,0]; R”), the sample Lyapunov-exponent of 
the solution of (1) can be estimated as 


Jim sup + log (e(t) <-2, as, (10) 
where y > 0 is the root of the equation 
= ‘min {(A +ô: + 9:8?) — (ô: + gib? T AB? }. (11) 
Proof Let V(g,t) = |z|?. Then the operator CV has the form 
LV = 227[ — Dz + Af(x) + Bg(y)] + trace[o7 (z, y, t)o(z, y, t)]. 
By the hypotheses, 


LV(a,y,t) < —227 Dz + 2? Cyr + 27 Bg(x) + g' (x)BT x +a Cyn + g7 (y)Cog(y) + y7 Czy 


(x? g"(y))H ( 


f i ) ) — z7 (C3 + D)x + y” Cay + g” (y)Gg(y) 


—A( |z|? + Jg)? ) — 27 (C3 + D)x + y7 Cay + 97 (y)Goly) 


IA 


= DO + 6; + gib)? + > (diy? + (9: - d)9? (y))- 


1=1 i=1 


It is easy to see from the construction of H and —\ = Amax(H) that À < g; for all 1 <i <n. 
Using (H2) one can then derive that 


LV(z,y,t) < YS (- (A+ 6: + g:6?)a? + (diy? + (gi — G77). 


t=1 


In order to apply Theorem 2.1, define ¢;, Yi € C(R; R+) by 


éi(ai) = 2?, pily) =Y, AX =A+6 49:07, ws = sit (Gi — AB. 
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It is obvious that 


V(a,t) = |z? = >> giles) = Do ia), M > Hee 


i=1 i=1 
Moreover 


LV(z,y,t) < X (-Aidi(ai) + medily:)). 
i=l 
By Theorem 2.1, for every € € C({—7, 0], R”), the solution of (1) has the property 
: 1 
jim, sup t log ( |x(t; €)|? ) <-7y, a.S., 


and the required assertion (10) follows. The proof is complete. 

In the following, we shall make use of the characteristics of recurrent networks to obtain 
further results. 

Corollary 2.1 Let (9) and (H2) hold. Assume that there exist nonnegative numbers 6; 
and 6; such that 


n 
trace[o7 (x,y, tho(x,y,t)] < X. [biz? + diy?l, (12) 
i=1 
for all (x, y,t) € R” x R” x Ry. Assume also that there exists a positive-definite diagonal 
matrix G = diag(g1,--- , gn) such that the symmetric matrix 
~2D+C,+D B 
BT -G 


is negative-definite, where D = diag(g:?,--- , @nG2). Let —À = Amax(H), the biggest eigen- 
value of H, so À > 0. If 


O,+6,<A, 1<i<n, (13) 


then the stochastic delay neural network (1) is almost surely exponentially stable. Moreover, for 
every € € C((~7, 0]; R”), the sample Lyapunov-exponent of the solution of (1) can be estimated 
as 


5 1 Y 
jim sup z log (|e(t6)1) < -5> 4-8» (14) 
where y > 0 is the root of the equation (11), as long as the À in (11) is determined by 


A= pain [À — (6; + 6i)]. (15) 
Proof Set Cy = diag(1,62,--- ,@n), C2 =0, C3 = diag(ô1, 52,--- , Ôn). Then (12) can be 
written as 
trace[o" (x,y, t)o(z, y, t)] < a7 Cx + 97 (y)Cog(y) + yT Cay. 
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In view of Theorem 2.2, it is sufficient to verify that the matrix H defined there is negative- 
definite. To do so, for any x, y € R”, compute 


—-2D+C,4+C3+0,+D B 
(a? yT)H x - Ge Ji +01,4+03+C4+ x 
y BT —-G+C, 
7 C1+C3 0 
= (eT yA] |en | OTS f 
y 0 C2 y 


n 


—X( |x|? + lul?) + 52 (0; + d:r? 


i=l 


IA 


IA 


—A(|2/? + lul? ), 


where À is defined by (15) and is positive due to (13). The proof is complete. 
Lemma 2.1 Let A be a real matrix and P be an invertible matrix then 


x’ Ay +yTATr <a? PPT +yT(P7!A)T (P7 Ayy. (16) 
Proof Infact, 


0 


lA 


|P?x — P~\ Ay|? = (PT x — P~1 Ay)" (PT x — P~! Ay) 


x’ PPTs — 27 Ay — yT AT x ty" (PA)? (P7 Ay. 


The required assertion (16) follows. 
Corollary 2.2 Let (H1), (H2) and (12) hold. Assume there exist an invertible matrix P 
and a positive-definite diagonal matrix G = diag(g1,--- , gn) such that 


Ay = 


—2D + PPT +(P-!AL)"(P-!AL)+D B 
BT -G 


is negative-definite, where D = diag(g18?,-- ,gn82), L = diag(ai,---,an). Let -ñ = 
Amax(H1), the biggest eigenvalue of Hı, so fi > 0. If 


6,4+6;<f, 1<i<n, (17) 


then the stochastic delay recurrent neural networks (1) is almost surely exponentially stable. 
Moreover, the sample Lyapunov exponent can be estimated by (14), as long as the A in (11) is 
determined by 
A= toes [a - (6; + 6:)| z (18) 
Proof Choose Cy = PP? + (P-1AL)T(P-!AL). The conclusion of Corollary 2.2 follows 
from Corollary 2.1. The proof is complete. 
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Corollary 2.6 Let (H1), (H2) and (12) hold. Assume there exist two positive-definite 
diagonal matrices Q = diag(€1,--- ,€n) and G = diag(gi,--: , gn) such that 


l —2D +Q + (AL)TQ-H(AL)+D B 
o BT -G 


is negative-definite, where D = diag(g1(?,--- ,9n02), L = diag(a,,---,an). Let —? = 
Amax(H2), the biggest eigenvalue of H2, so Ò > 0. If 


6; + 6; <T, l<i<n, (19) 


then the stochastic delay recurrent neural networks (1) is almost surely exponentially stable. 
Moreover, the sample Lyapunov exponent can be estimated by (14), as long as the À in (11) is 
determined by 


A= ymin [P — (6; + 6;)]. (20) 


Proof Choose the invertible matrix P = diag(,/é1,--- ,/én). The conclusion of this 
Corollary follows from Corollary 2.2. The proof is complete. 


3 Examples 
Example 3.1 Consider a two-dimensional stochastic delay recurrent neural network 
dx(t) = | — Dz(t) + Af(x(t)) + Bg(x,(t))]dt + Big(z,(t))dW(t), (21) 


where W(t) is a real-valued scalar Brownian motion, both 7, and 72 are positive numbers, 


0.1 —0.1 2 —2 
= 3 B= , 
0.1 0.1 1 1 
4 0 
D= ava , O(x,y,t) = (0.2y2, 0.591)”, 


while fi(z;) = (aixi A 1) V (—1) with 


l-e¥ . 
ay = 0.4, Q2 = 0.3, gilyi) = ite’ .= 1,2. 


It is easily shown that (H1) is satisfied with a; = 0.4, a2 = 0.3 atid (H2) is satisfied with 
pı = Be = 1, respectively. To apply Theorem 2.2, note in this example such that 


Cy = Ca = 0, C3 = diag(0.25, 0.04), 


L = diag(0.4,0.3), o7 (2, y, t)o(a, y, t) = 0.25y? + 0.04y2. 
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Choosing P = diag(0.2,0.2) in Lemma 2.1, then P7! = diag(5,5), we have 

a Af (x) + f7(x)At < £T (PP? +(P7!AL)"(P7'AL))z, 

C4 = PPT + (P~1AL)"(P™'AL) = diag(0.12, 0.085), D=G, 

—2D + C, + C3 + C4 = diag(—7.63, —3.875). 


Now, choose D = diag(3.815, 1.9375). The matrix H defined in Theorem 2.2 becomes 


—3.815 0 2 —2 
0 —1.9375 1 1 
H= 
2 1 —3.815 0 
—2 1 0 —1.9375 


Compute Amax(H) = —0.1512 which means that H is negative-definite. By Theorem 2.2, the 
stochastic delay recurrent neural network (21) is almost exponentially stable. To estimate the 
sample Lyapunov-exponent, compute, by (11), y satisfied 


y = 4.2162 — 3.913877. (22) 


If both 7; and 7) are 0.1 then 7 = 0.1 and (22) has a unique root y = 0.2166. Therefore, 
Theorem 2.2 shows that the sample Lyapunov-exponent of the solution of network (21) should 
not be greater than —0.1083. 

If A = 0 in (21), the model (21) changes into the stochastic Hopfield neural network. 
Choosing G = diag(3.875, 1.98), we have 


—3.875 0 2 —2 
0 —1.98 1 1 
H= 
2 1 —3.875 0 
—2 1 0 —1.98 


Compute Amax(H) = —0.1957 which means that H is negative-definite. By Theorem 2.2, the 
the stochastic delay recurrent neural network (21) is almost exponentially stable. To estimate 
the sample Lyapunov exponent, compute, by (11), y satisfied 


y = 4.3207 — 3.9293e77. © (23) 


If both 7; and 72 are 0.1 then 7 = 0.1 and (23) has a unique root y = 0.2798. Therefore, 
Theorem 2.2 shows that the sample Lyapunov-exponent of the solution of stochastic Hopfield 
neural network (21) should not be greater than —0.1399. Obviously, if A = 0 in (21), this 
upper bound of the sample Lyapunov-exponent is less than the upper bound of the sample 
Lyapunov-exponent, -0.0834, computed in Example 4.1 in [6]. 

Example 3.2 Consider another three-dimensional stochastic delay recurrent neural net- 


work 


dz(t) = [ - Da(t) + Af(x(t)) + Bg(x-(t))]dt + Bıg(£-(t))AW (¢), (24) 
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where W(t) is a scalar Brownian motion, By is a 3 x 3 constant matrix and 


a: es la 440. 2 
D = diag(3,4,3), A=] 0 1 1 |, B=] -1 -2 1 |, 
0 1 -i ee ae | 


Fi(xi) = (aizi A 1) V (—1) with 


a, =0.3, a2=04, a3 =0.5, f(z) = (fi(21), fz(22), fa(x3)) 


T eßiYı — e hiv ; 
g(x) = (n (y1), 92(¥2), 93(ys)) » gly) = fis Leb? i = 1,2,3, 


with 6, = 0.4, G2 = 0.5, 83 = 0.4. Clearly, (H1) and (H2) are satisfied. Note that o(z,y,t) = 
Bıg(y) and 


o7 (x,y, t)o(x,y,t) < IBP)? < Bull? (6?y? + 23y2 + B3y3] < 0.25|| Bi |? lyl?. 
That is, (12) hold with 6; = 0, 6; = 0.25||B,||?._ To apply Corollary 2.3, take Q = E, G = 
diag(5, 4,5), then 
—4.11 -0.12 -0.15 -1 0 2 
—0.12 -564 02 -1 -2 1 
—0.15 0.2 -345 1 -1 —-1 


H = 
-1 -1 1 -5 0 0 
0O -2 -1 0 —4 0 
2 1 -1 0 0 =š 


Compute that 7 = —\max(H2) = 1.5294. Let 6; + 6; = 0.25||B1||? < D. Hence, (19) be- 
comes 0.25ļ|| Bı ||? < 1.5294, namely ||B,|| < 2.4733. Corollary 2.3 therefore concludes that the 
stochastic delay recurrent neural network (24) is almost surely exponentially stable as long as 
\|Bi|| < 2.4733. 

If A = 0 in (24), the model (24) changes into the stochastic Hopfield neural network. To 
apply Corollary 2.3, take G = diag(10, 8, 10), then D = diag(1.6, 2, 1.6) and 


-44 0 0 ~1 0 2 
0 -6 0 ~1 -2 1 
-2D+D B 0 0 -44 1 -l -1 
H = = 
BT -G -1 -1 1 -10 0 0 


Compute that 0 = —Amax(H2) = 3.2622. Let 6; + 6; = 0.25||B1]|? < D. Hence, (19) becomes 
0.25])Bi ||? < 3.2622, namely ||B1|| < 3.6123. Corollary 2.3 therefore concludes that the stochas- 
tic Hopfield neural network (24) is almost surely exponentially stable as long as ||Bi|| < 3.6123. 
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Obviously, if A = 0 in (24), this upper bound of ||B;|| is bigger than the upper bound of ||B;||, 
3.189, computed in Example 4.3 in [6]. 


References: 


[1] Wang J, Wu G. A multilayer recurrent neural network for solving continuous-time algebraic Riccati equa- 
tions[J]. Neural Networks, 1998, 11: 939-950 

[2] Zhang Y N, Jiang D C, Wang J. A recurrent neural network for solving sylvester equation with time-varying 
coefficients(J]. IEEE Trans Neural Netw, 2002, 13(5): 1053-1063 

[3] Zhang Y N, Ge S S. Design and analysis of a general recurrent neural network model for time-varying 
matrix inversion|[J]. IEEE Trans Neural Netw, 2005, 16(6): 1477-1490 

[4] Liao X, Mao X. Exponential stability and instability of stochastic neural networks[J]. Stochast Anal Appl, 
1996, 14(2): 165-185 

[5] Liao X, Mao X. Stability of stochastic neural networks{J]. Neural Parallel Sci Comput, 1996, 4(2): 205-224 

[6] Blythe S, Mao X, Liao X. Stability of stochastic delay neural networks[J]. Journal of the Franklin Institute, 
2001, 338: 481-495 

[7] Niu J R, Zhang Z F, Xu D Y. Exponential stability in mean square stochastic Cohen-Grossberg neural 
network with varying delays[J]. Chinese Journal of Engineering Mathematics, 2005, 22(6): 1001-1005 

(8] Zhang Z F, Xu D Y, Deng J. Exponential stability of stochastic reaction-diffusion neural network with 
time-varying delays[J]. Chinese Journal of Engineering Mathematics, 2008, 25(2): 219-223 

[9] Jiang M H, Shen Y, Liao X X. Exponential stability of stochastic differential equation with time-varying 
delay[J]. Chinese Journal of Engineering Mathematics, 2006, 23(6): 961-965 

[10] Liptser R Sh, Shiryayev A N. Theory of Martingales[M]. Dordrecht: Kluwer Academic Publisheres, 1986 


FEF BEAL AT i HS WS EEA EIS 
KPH, REN 
(1- ERLAR, Ik ERE 222005; 2- WIKSA, MAB 610064) 


i E AERA EH. Lyapunov Z MAE AIS BD REE TER K BE I SP 2 BY 
BEAL Se SBS we te, SEU TARAA Oe E E he EE, BT NE RY AS FA. PS 
DFA KBW HEEE BEL Hopfield #28 tE Br te KARRE th OE FARI Al SE 

Rid: MPBIAMA, Zn, MOTE TE; FA Lyapunov KA 


